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Indirect-adaptive Model Predictive Control 
for Linear Systems with Polytopic Uncertainty 

Stefano Di Cairano 


Abstract 

We develop an indirect-adaptive model predictive control algorithm for uncertain linear systems subject to 
constraints. The system is modeled as a polytopic linear parameter varying system where the convex combination 
vector is constant but unknown. Robust constraint satisfaction is obtained by constraints enforcing a robust control 
invariant. The terminal cost and set are constructed from a parameter-dependent Lyapunov function and the 
associated control law. The proposed design ensures robust constraint satisfaction and recursive feasibility, is input- 
to-state stable with respect to the parameter estimation error and it only requires the online solution of quadratic 
programs. 


I. Introduction 

In Model Predictive Control (MPC) |[I1 the prediction model is exploited for evaluating feasibility and 
performance of the sequence of actions to be selected by the controller. In several cases, some of the model 
parameters are uncertain at design time, especially when a controller is deployed to multiple instances 
of the plant, such as in automotive, factory automation, and aerospace applications O, S, where the 
control algorithm and its auxiliary functions need also to have low complexity and computational effort, 
due to stringent cost, timing, and validation requirements. 

For the cases when model parameters are uncertain, robust MPC methods have been proposed, see, 
e.g., m-M- Some of the limitations of these methods are either in the computational cost, due to 
solving linear matrix inequalities (LMIs) at each control step [l4l-[l6l, or in applying online to additive 
disturbances 0, or in imposing limitations on cost function and terminal set flU. These limitations often 
arise due to considering the challenging case where uncertain parameters are constantly changing during 
system operation. 

However, when the parameters are unknown but are constant or slowly varying over time, an alternative 
approach is to learn their values, resulting in adaptive control techniques that ensure safe operation 
during the learning phase, and improve performance, for instance in terms of stability or tracking, 
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as the learning proeeeds. Adaptive MPC algorithms have been reeently proposed based on different 
methods, sueh as a eomparison model 0, min-max approaches with open-loop relaxations IfTOll . learning 
of constant offsets EUl, and set membership identification llT^ . Another class of adaptive MPC algorithms 
focuses on “dual objective control”, i.e., controlling the system while guaranteeing sufficient excitation 
for identifiability, see, e.g., lfT3]| - lfT5]| . and references therein. 

In [fT^ . a MPC design allowing for the prediction model to be adjusted after deployment was proposed. 
In this paper we propose a MPC design that operates concurrently with a parameter estimation scheme, thus 
resulting in an indirect-adaptive MPC (lAMPC) approach, that retains constraints satisfaction guarantees 
and certain stability properties. Motivated by the case of the unknown but constant (or slowly varying) 
parameters and by the need to keep computational burden small for application in fast systems equipped 
with low cost microprocessors 0, Q, here we do not seek robust stability as in robust MPC, but rather 
robust constraint satisfaction and an input-to-state stable (ISS) closed-loop with respect to the estimation 
error. ISS will hold with only minimal assumptions on the estimates, and if the correct parameter value 
will be eventually estimated (possibly in finite time, see, e.g., ifTTll f. by the definition of ISS the closed- 
loop will become asymptotically stable (AS). Constraint satisfaction holds even if the parameters keep 
changing. 

For uncertain systems represented as polytopic linear difference inclusions (pLDI) we design a parameter- 
dependent quadratic terminal cost and a robust terminal constraint using a parameter-dependent Lyapunov 
function (pLF) ifT^ and its corresponding stabilizing control law. Robust constraint satisfaction in presence 
of parameter estimation error is obtained by enforcing robust control invariant set constraints [[T9ll . A 
parameter prediction update law is also designed to ensure the desired properties. The proposed lAMPC 
allows uncertainty in the system dynamics, as opposed to additive disturbances/offsets as in [|71|, ifTTI . and 
only solves quadratic programs (QPs), as opposed to robust MPC methods that require the online solution 
of LMis (51, (a. 

The paper is structured as follows. After the preliminaries in Section |nl in Section |III] we design the 
cost function that results in the unconstrained lAMPC to be ISS with respect to the estimation error. 
For constrained lAMPC, in Section |IV] we first design the terminal set that guarantees that the nominal 
closed-loop is AS. Then, we design robust constraints that ensure that the system constraints are satisfied 
and the lAMPC remains feasible even in presence of parameter estimation error. In Section |V] we combine 
the cost function and the constraints with a parameter estimate prediction update and we briefly discuss 
the required properties of the estimator, hence describing the complete lAMPC. In Section |Vl] we show 
a numerical example. Conclusions and future developments are discussed in Section IVIII 

Notation: M, Mo-i-> '^o+, are the sets of real, nonnegative real, positive real, and integer. 
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nonnegative integer, positive integer numbers. We denote interval of numbers using notations like 1j[a,b) = 
{z e Tj a < z < b}. co{X} denotes the convex hull of the set X. For vectors, inequalities are 
intended componentwise, while for matrices indicate (semi)definiteness, and Amin(Q) denotes the smallest 
eigenvalue of Q. By [x]i we denote the i-th component of vector x, and by / and 0 the identity and 
the “all-zero” matrices of appropriate dimension. || ■ ||p denotes the p-norm, and || ■ || = || ■ II2. For a 
discrete-time signal a; G M" with sampling period T^, x{t) is the state a sampling instant t, i.e., at time 
Tst, Xk\t denotes the predicted value of x at sample t + k, i.e., x{t + k), based on data at sample t, and 
Xo\t = x{t). A function a : Mo+ —)■ Kq-i- is of class /C if it is continuous, strictly increasing, a(0) = 0; if 
in addition linic^oo ol{c) = cxo, a is of class /Coo- 

II. Preliminaries and Problem Definition 

Details on the following standard definitions and results are, e.g., in [[B Appendix B]. 

Definition 1: Given x{t -f 1) = f{x{t),w{t)), x G M"-, tc G W C M'^, a set SS C M” is robust positive 
invariant (RPI) for / iff for all x G SS, f{x,w) G SS, for all tc G W. If tc = {0}, SS is called positive 
invariant (PI). □ 

Definition 2: Given x(t-|-l) = f{x{t),u{t),w{t)), x G M", u & U M™-, tc g W C a set SS C M"" 
is robust control invariant (RCI) for / iff for all x G SS, there exists u eU such that f{x,u,w) G SS, 
for all tc G W. If tc = {0}, SS is called control invariant (Cl). □ 

Definition 3: Given x{t -f 1) = f{x{t)), x G M", and a PI set SS for /, 0 G SS, a function V : M" —)■ 
Mo-i- such that there exists Q!i,a2,ttA G /Coo such that a!i(||a;||) < V{x) < a!2(llT|l), V{f{x)) — V{x) < 
—aA(||T||) for all T G S'S' is a Lyapunov function for / in S'S'. □ 

Definition 4: Given x{t -f 1) = f{x{t),w{t)), x G M”, tc G 'FV C M'^, and a RPI set SS for /, 
0 G SS, a function V : M” ^ M+ such that there exists Q!i,a2,Q!A G /Coo and 7 G /C such that 
ai(||T||) < V(x) < a2(||T||), V{f{x)) — V(x) < —aA(||T||) -1- 7(||tc||) for all x G SS, tc G IV is an 
input-to-state stable (ISS) Lyapunov function for / in SS with respect to w. 

Result 1: Given x{t -f 1) = f{x{t)), x G M”, and a PI SS for /, 0 G SS, if there exists a Lyapunov 
function for / in S'S', the origin is asymptotically stable (AS) for / with domain of attraction SS. Given 
x{t -I- 1) = f{x{t),w{t)), X G 'MS, w E W M'^, and a RPI SS for /, 0 G SS, if there exists a ISS 
Lyapunov function for / in SS, the origin is ISS for / with respect to w with domain of attraction SS. 
We consider the uncertain constrained discrete-time systems with sampling period Tg, 

e 

-(i+i) = E® iAix{t) + Bu{t), (la) 

i=l 

X E X, u eU 


(lb) 
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where Ai G i G and B are known matriees of appropriate size, and X C M”, U C M"* are 

eonstraints on system states and inputs. In ([T]), the uncertainty is associated to ^ G S C which is 
unknown and constant or changing slowly with respect to the system dynamics, and S = {.^ G : 0 < 
[^]i < 1, = !}• ^ convex combination vector, since it describes a convex combination 

of the “vertex systems” fi{x,u) = AiX + Bu, i G 

Assumption 1: An estimator is computing the estimate of ^ such that ^(f) G S for all t G Zo+. 
We denote by ^(t) = ^ (t) — the estimation error at time t for which it holds that ^ G H. Given 

G H, for shortness we write ^ G S(,^), where S(,^) = {.^ G : 3.^ G S, .^ = is the set of possible 

estimation error vectors. Assumption [T] is what is required from the estimator for the development in this 
paper to hold. Some comments on how to design estimators that satisfy Assumption [T] are given later, in 
Section IV-AI 

Remark 1: The trajectories produced by (fTal) are a subset of those of the pLDI 

x(t + 1) G co{Aix(t) + Bu(t)}i^i. (2) 

The pLDI (I2l) is equivalent to (fTal) if a varying parameter vector, i.e., ^(t), is considered. 

Consider the finite time optimal control problem 


=min x'^>tV{^N\t)xN\t + (3a) 

A^-1 

^ ^ Xk\tQ^k\t T '^k\t^^k\t (3b) 

k=0 

i 

s.t. Xk-{-i\t T Buk\t (3c) 

i=l 

Uk\t £ Xk\t £ X (3d) 

(^fc|t) ^k\t) ^ ^XU (3e) 

XN\t £ 'T’tv (3f) 

xo\t = x{t), (3g) 


where N G M+ is the prediction horizon, Q G R G Q,R> 0, V{^) G V{^) > 0, 

for all ^ G S, Cx,u ^ X xU, Ut = [uQ\t . .. MAr-i|t] is the sequence of control inputs along the prediction 
horizon, and S,t = [^o|i • • • iN\t\ £ is a sequence of predicted parameters, not necessarily constant. 

Let U* = [mq|^ .. . be the solution of dU) at t G Zo+. 

Problem 1: Given (fU) and an estimator producing the sequence of estimates {^(f)}t such that ^{t) G S 
for all t G Zo+ according to Assumption [U design the sequence of predicted convex combination vectors 
the terminal cost P{^), the robust terminal set Xn, and the robust constraint set C^u in dU) so that the 
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lAMPC controller that at any t e Zo+ solves © and applies u{t) = aehieves: (i) ISS of the elosed- 
loop with respect to = ^ — ^o|t> (**) robust satisfaction of the constraints including when ^o|t 7^ 0, 
(in) guaranteed eonvergenee of the runtime numerical algorithms and computational load comparable to 
a (non-adaptive) MPC. 

In Problem [H (i) is concerned with eonditions on the behavior during the estimation transient and when 
the estimate has converged, (ii) is eoneerned with the system safety in terms of constraints satisfaction, 
and (Hi) is concerned with eomputational requirements, especially due to recent applications to fast 
systems O, ||3l. 

Problem [H requires robust eonstraint satisfaction (as in flUl, [|5l, [|71) and ISS, i.e., a proportional effect 
of the estimation error on the elosed-loop Lyapunov function. The rationale for seeking ISS rather than 
robust stability as in flUl, [|5l| is that, when the unknown parameters do not ehange or ehange slowly, 
a “well designed” estimator should eventually eonverge to correct value, and henee, by ISS definition, 
the elosed-loop becomes AS. However, ISS holds regardless of the estimator eonvergenee as long as 
Assumption [U is satisfied, as well as robust constraint satisfaction, which has to be guaranteed also in 
presenee of estimation error and thus is guaranteed even if the parameters change. While this paper foeuses 
on a control design independent from the estimator design, the dependency of the closed-loop performance 
on estimation error is captured by the expansion term in the ISS Lyapunov function. 

Consider the linear parameter-varying (LPV) system 

e 

i^(« + i) = EKW1 iAix{t) + Bu{t), (4) 

i=l 

where for all f G .^(f) G S, the parameter-dependent (linear) control law 


u = = 



(5) 


and the parameter-dependent (quadratic) function 




x'V{C)x = x' 



( 6 ) 


where P* > 0, i G 

Definition 5 ( /f7^/).- A funetion ® such that V^(i+i)(a;(f-|-l))—V 5 (t) (a;(f)) < 0, for all .^(f), .^(f-l-l) G S, 
where equality holds only if x = 0, is a parameter-dependent Lyapunov function for dH) in elosed-loop 
with ®. □ 


6 


By BSl, [fT^ . IfT^ . given Q e R e Q,i? > 0, any solution Gi,Si G S'* > 0, 

E, e i e Z[ 1 ,£], of 


Gi+cr-Si 

{AiGi+BEiY 

K 

G' 

{AiGi+BEi) 

Sj 

0 

0 

Ei 

0 


0 

Gi 

0 

0 



> 0, vi,j e Z[1,^]. 


(7) 


is such that ([5]), ® where Pi = \ Ki = EiG^ \ i e Z[i^£], satisfy 


V(a;(f + l),e(f + l))-V(x(f),e(f)) < (8) 

- x{ty{Q + K(^(f))'i?K(^(f)))a:(f)', V^(f), + 1) e S 


for the closed-loop ©, ([5]). 

Assumption 2: For the given Ai, i G B, Q, R, (|7]) admits a feasible solution 
The LMI (|7]) is a relaxation of those in dH, [|5l since it allows for a parameter-dependent Lyapunov function 
and a parameter-dependent linear control law. Thus, Assumption [2] is more relaxed of and implied by the 
existence of an (unconstrained) stabilizing linear control law for the uncertain system (fTal) , see, e.g., dH, 
dsi- Indeed, if the vertex systems are such that the uncertainty is too large, (|7]) may be infeasible, similarly 
to the case where a stabilizing controller for an uncertain system does not exist. However, since dl]) is used 
here for design, such situation will be recognized before controller execution and corrective measures, 
such as improving the engineering of the plant or resorting to other control techniques can be actuated. 
By using (|7]) only for design, as opposed to dUl, d3l, the proposed method solves online only QPs, which 
makes it feasible also for applications with fast dynamics and low-cost microcontrollers d3> dH. 

Remark 2: Here we consider the case where i? in dH) is independent of the uncertain parameters due 
to the limited space, as this allows to shorten several derivations. The expanded derivations related to the 
case of uncertain B will be included in future/extended versions of this work. 


III. Unconstrained IAMPC: ISS Property 
We start from the unconstrained case, A" = M"', W = M™. 


A. Stability with parameter prediction along the horizon 

We begin by considering a simpler case where S,k\t = i{t + k), k & where it is possible that 

'Cfcili 7^ ik 2 \u for ki,k 2 G Z[o,Ar]. This corresponds to controlling an LPV system with preview on the 
parameters for N steps in the future, but no information afterwards. 

Lemma 1: Let Assumption |2] hold and consider dll) and the MPC that at f G Zo+ solves d3]) where 
Aat = a = ML, U = M™, Cxu = U = EE, ^k\t = + k), and V{^), are from dl]). Then, 
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the origin is AS for the elosed loop with domain of attraetion for every sequenee sueh that 

^{t) e S, for all t e Ro+. 

Proof: We follow the proofs for unconstrained MPC extended to time-varying systems, see, |[I1 
Sec.2.4]. For dH) in closed-loop with ([5]) designed by ([7]), dS]) holds, where V in dS) is designed also by dZ]). 
Thus, in dH), is lower and upper bounded by class /Coo functions, a(||x(f)||) = XminiQ)\\xit)f, 

«(I|3^WII) = where e R+ and v = Amax(Zi), for any e see [HI Sec. 

2.4.5]. From x(t), let U*(t) = [mq|j ... be the optimal solution of dll). At f-l-1 from x(t + l) = Xi\t, 

[wolt-l-l • • •'UAr-l|t+l] where Uk\t +1 = '^k+l\t ^ ^ Z[ 0 ,Ar- 2 ]> UN-l\t+l = has cost J < 

V^^'^{x{t)) -x{tyQx{t), due to dS]) and y,k\t+i = Cfe+i|t, for all k e Z[o^n-i]- Since V^^^{x{t + 1)) < J, 

V^^{x{t + 1)) - V^^{x{t)) < -x{f)Qx{f) 

< -Amin(Q)||a:(f)|P = aA(lk(f)||), 

and a A G /Coo- Thus, V^'^{x{t)) is a Lyapunov function for the closed-loop system for any such that 
y,t\k = + k), and hence the origin is AS in R"^. ■ 

By Lemma [H the MPC based on dll) with perfect preview along the horizon is stabilizing. Next we 
account for the effect of the parameter estimation error. 


B. ISS with respect to parameter estimation error 

Consider now the case relevant to Problem [D where is constant, i.e., ^{f) = for all t E Zo+, 
unknown, and being estimated. Thus, .^o|i = ^ ~ 'Co|t is the error in the parameter estimate, which may be 
time-varying, and ^o|t ^ 2(^o|t)- The parameter estimation error induces a state prediction error 


i i i 

- '^[^0\t]iAiX = '^[iofiAiX. ( 9 ) 

2=1 2 = 1 2=1 


Indeed, 


^tr. 


< 




i=l 

C 


< 




i=l 


\X\ 


X] l[fo|t]*| IIAII ||a:|l < 7A||fo|t||ilk| 


, 2=1 


( 10 ) 


where 7 a = maxi=i„„^ ||Aj||. 

Consider the value function of dH), the following result is straightforward from [HI. 

Result 2: For every compact Xl C R”, the value function of dll), where V{i) is designed according 
to dZl), is Lipschitz-continuous in a; G Xl, that is, there exists L E R+ such that for every a:i,a;2 G Xl, 










— V|^r^‘^(a; 2 )|| < L\\xi — X 2 \\, for every e 

Result [2] follows directly from the fact that for every e is piecewise quadratic |[I1 and 

hence it is Lipschitz continuous in any compact set Xl. Thus, for any Xl C and E there 

exists a Lipschitz parameter L^n E M+. Since is compact, i.e., closed and bounded, there exists a 

maximum of L^n E M+ for E Such maximum is the Lipschitz constant L. 

Lemma 2: Let = ^k\u for all k E t E Zo+. Then, there exists 7 ^ > 0, such that for 

every x E Xl, 

+ 1)) <V^T‘^(a;(t)) - Amin(Q)lla:(f)|P 

+ 7L||fo|t||il|3;WII- ( 11 ) 

Proof: By Lipschitz continuity of V^'^{x), 

+ 1 )) - V^^^{xi\t) < L\\e^{t)\\ < 7 AT||fo|Ji|| 2 ^|| 

Also, due to the result of Lemma [U 

-V^^^{x{t)) < -Amin(Q)||a:|l^ 

Thus, 

Vf/^{x{t + 1)) < V^^^{x{t)) - Amin(Q)|la:|p + 7L||fo|t||i||a;|| 

where 7 ^, = 7 ^^. ■ 

Theorem 1: Let Assumptions [H [2] hold, and ^A;|t+i = for all k E Z[o,Ar_i], and all t E Zo+. 

For the MFC that at any step solves ([3]) where P(^) is designed according to (Q, X^ = X = M”, 
U = Cxu = IT = M”^, is an ISS-Lyapunov function with respect to the estimation 

error ^o|t = ^ — ^o\t ^ S(^o|t) for © in closed loop with the MFC based on @ in any C X^, where 
Xjj is RFI with respect to ^o|i for the closed loop. 

Proof: By Lemma |2] we have that 

V^^^{x{t + 1)) < V^^^{x{t)) - Amin(Q)||a;|r+ 7L||fo|t||i||a;||- 

Due to the norm equivalence in finite dimensional spaces, for a p-norm, there exists jp such that 
IlfoiJi < 7 pllfo|t|| for every e MP. Hence, 

V^^^ixit + 1)) < V^^^ixit)) - A^i„(g)||a:f + 7 l7pIIWIII|x||. 

Since X^ C Xl and Xl is compact, there exists a finite 7 r, > 0 such that ||a;|| < 7 ,, for all x E X^. 


Then, for all x G where is RPI with respeet to .^o|t ^ S('Co|t)> 

+ 1)) < V^^^{x{t)) - Amin(Q)|lx(f)||^ + 7iss||fo|t|| (12) 

and the closed-loop is ISS with respect to ^olt, with ISS Lyapunov function and ISS gain 7133 = 

7L7p7r?- ■ 

Theorem [T| requires the existence of a RPI set contained in Xl because that is where the value 
function is Lipschitz-continuous. For 7 > 0, C such that for all G < 7 and for all 

X G Xrj, — Amin(Q)||a:p < 7] —2^^11x11 is RPI, because of Lemma [2] and ||f||i < 2, for all ^ G S(^). 
For the case of constrained lAMPC where X is compact, for ensuring constraint satisfaction we need to 
construct a compact RPI set Xj^ C X, so that we can define Xl = X^, and Result holds in X^. Next, 
we focus on the case of A”, W compact and how to build X^ for constrained lAMPC. 

IV. Constrained IAMPC: Robust Constraints 

By designing the terminal cost from a pLF as in Section |nll the closed loop of ([U) with the unconstrained 
IAMPC that solves ([3]) is ISS with respect to fo|t- Next, we consider constrained IAMPC, i.e., X xU d 

M" X 

Assumption 3: X, U are compact sets, 0 G int(A), 0 G int(W). 

Under Assumption^ we first show that for the LPV system dH) with perfect preview along the prediction 
horizon, i.e., ^k\t = + k), for all k G the closed-loop recursively satisfies the constraints and is 

AS. Then, we enforce constraint satisfaction when ,^o|t ^ 0. These objectives are achieved by designing Ajv 
and Cxu in dH), respectively. 

A. Terminal set design for nominal terminal constraint 

Consider dH) where ^{f) is known at f G Zo+ and the control law dS]) resulting in the closed-loop LPV 
system 

i 

x{t + 1) = ^[e(f)].(A, + BKi)x{t)- (13) 

The trajectories of (fT3l) are contained in those of the pLDI 

x{t -f 1) G co{(Aj -f BKi)x{t)}i^^. (14) 

For (fT4l) in closed loop with dS]) designed by dZ]) subject to (fTbl) . in ifT^ it was shown that the maximum 
constraint admissible set X°° C X, where X = {x G X : k(^)x E G S} is polyhedral, finitely 

determined and has non-empty interior with 0 G int(A°°). X°° is RPI for (fT3l) for all ^ G S, and is 
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the limit of a sequence of backward reachable sets. Let be a given set of feasible states and inputs 
^xu ^ X X U, 0 E mi{Xxu) and let 

= {x : {x,Kix) e Vi e 
= {x : {A, + BKi)x G X^^\ Vi e Z[i,£]} n X^^^ 

= lim X^^\ (15) 

/l—>-oo 

Due to the finite determination of X^ there exists a finite h G Zo+ such that = X^’^'> = X°^, i.e., 

the limit in ([T?]) is reached in a finite number of iterations. 

Lemma 3: Consider (U) and the MFC that at f G Zo+ solves dU) where X C M”, U C Cxu = 

^k\t = + k), V{i), are designed according to © and X^ = X°°, where X°° is from (fTSl) . At a 

given t G Zo+, let x{t) G X, G be such that ® is feasible. Then, @ is feasible for any r > t, 

i.e., Xf{^^) = {x G A” : @ feasible for xo\t = x, ^k\t = ^ S, k E Z^o.at]} is a PI set, and the origin 

is AS in Xf{i^). 

Proof: First we show that Xf{^^) C A is PI for the closed-loop system, i.e., if x{t) G Xf{^^), then 

x{t + 1) G for all + 1 + A) G H. Since x{t) E Xf{^f), there exists U*{t) = 

optimal (and feasible) for @. From x{t + 1) = Xi|i, given consider U = [Mo|t-i-i • • • UN-i\t+i\, where 
Uiit+i = for i E Z[0,7V_2], fi7v-i|t+i = K{^N\t)xN\t- By ^t\k = + k), it holds = ^k+i\t, and 

the trajectory generated by U is such that Xfc|t+i = Xk+i\t, Xk\t+i £ A, Uk\t+i E U for all k E Z[o,Af-i]- 
Since A^r = X°°, XM-i\t+i = XN\t ^ A°° C A and K{^N-i\t+i)xN\t ^ W for all ^N-i\t+i ^ Z, hence (1^ 

is satisfied. Also, xn^+i £ A^, because X^ = X°° is PI for @ in closed loop with © for all G H. 

Thus, also dSB is satisfied and U is feasible from x(f + 1) for any that is admissible according to 
the assumptions, and x{t + 1) G Xf{^^^). Hence, Xf{^^) is PI. AS follows by the same arguments of 
Lemma [H with as Lyapunov function, and with Xf(^^) as domain of attraction. ■ 

Next, we ensure robust satisfaction of (1^ . (1^ . in presence of estimation error 7^ 0. 

B. Robust constraints design 

In order to ensure robust constraint satisfaction in the presence of parameter estimation error we design 
the constraint (1^ from a RCI set for the pLDI @, whose trajectories include those of (fTal) . Based on 
Definition [2l let C C A be a convex set such that for any x E C there exists u eU such that AiX + Bu E C 
for all i E Z[i^£]. Given C, we design Cxu in (1^ as 

Cxu = {{x,u) eC xU, AiX -f Bu E C, Vi G Z[i^£]}, (16) 

that is, the state-input pairs that result in states within the RCI set for any vertex system of the pLDI @. 
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Lemma 4: Consider (|3]) where = M"', and C^u in (1^ is defined by (fT^ . If x{t) G C, ([3]) is feasible 
for all r >t, for any e and any fo|r ^ S(^o|r)- 

Proof: Due to the definition of Cxu, for all x G C there exists u sueh that (x, u) G Cxu- Thus, if 
{x{t),u{t)) G Cxu, by convexity x{t + 1) = + Bu{t) eC (LX, for all + ^o\t = ^ eE, 

i.e., (1^ and hence (1^ are satisfied for any actual ^ E E. Since x{t + 1) G C, the reasoning can be 
repeated proving robust feasibility for any r > t. ■ 

C can be computed as the maximal RCI set for Q from the sequence IfT^ . 

= A’, (17a) 

Cih+i) = . 3ueU, 

AiX + BuE Vi G (17b) 

The maximal RCI set in X is the fixpoint of (fTTl) . i.e., C°° = such that and is the 

largest set within X that can be made invariant for Q with inputs in lA. 

Based on Lemma IH by Cxu in (HU) we obtain constraint satisfaction even when ^o|i 7^ 0- However, 
the maximal RCI set does not guarantee that the terminal constraint can be satisfied, that is, it may not 
be possible to reach AV in iV G steps for all a: G C by trajectories such that {xk\t,'Uk\t) € Cxu- 
Furthermore, for Lemma [3] to hold, the control inputs generated by (|5]) that make Xjq PI for (fT3l) must 
be feasible for dU), that is, {x, n{^)x) G Cxu for every x G Xm, i lE. 

To guarantee satisfaction of the terminal constraint, the horizon N needs to be selected such that for 
every x E C and E there exists [m(0) . . .u{N — 1)] such that for dH) with a:(0) = x, ^{k) = 

for all k E Z[o,Af], {x{k),u{k)) G Cxu for all k E Z[o,Af-i], and x[N) E Xm- Let 

= Xn, 

= {xeX : BueU, AiX+ BuE 
£ 

i=l 

The set 5'S'^^^ is such that for any x(0) G given any G E^, there exists a sequence 

[m(0) .. .u{h — 1)] such that for dll) with x(0) = x and ^{k) = for all k E Z[o,Af], {x{k),u{k)) E Cxu 
and x{h) G X^- 

Theorem 2: Consider ([3]), let h E Zo+ be such that = C^^'^ = C in (fTTl) . and let Cxu be defined 

by dUl). Let X^ = X°° from (fTSl) . where Xxu = Cxu, and N E Zo+ be such that L C. If x{t) G C at 

t E Zo+, and E fo|r ^ ^('Co|r) for all r > f, dl]) is feasible for all r > f. If there exists t E Zo+ 

such that ^k\T = ^(r + k) for all r > f, fc G Z[o,Af], dB in closed-loop with the MPC that solves dl]) is also 
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AS in C. 

Proof: Since C C for every x{t) G C and G there exists an input sequenee of length 

N such that {xk\t,Uk\t) G for all k G and XN\t G Due to Lemma HI for uo\t sueh that 

(a^oio Uo\t) e Ca:u, Ei=i[^o|t + io\t\iAxo\t + Buo\t G C, for every e S(^o|t)- Furthermore, if G 

f-Qj. 

T > t, AS in C of dU) in elosed-loop with the MFC that solves dH) follows from Lemma |3] 
noting that if XN\t e Xn, XN-i\t+i = XN\t, and UN-i\t+i = A^N\t)xN\t, then {xN-i\t+i,UN-i\t+i) e 

i.e., dS]) is admissible in X^ with respeet (1^ . whieh follows from eomputing Xn by dTSl) with X^u = Cxu- 

■ 

In the definition of i.e., (fTSl) . the parameter sequence is known. This is due to enforcing the 

terminal set only with respeet to the nominal dynamies, while the robust invarianee of C and ehoosing N 
so that ^ C guarantee that at a sueeessive step, even in presenee of a parameter estimation error 

whieh eauses a prediction error, the terminal set will still be reaehable in N steps. 

There are alternative ways to eompute C, other than as the maximal RCI. For instanee, an RPI set ean 
be construeted from (fT4l) by including additional constraints in dU)- Then, for given N G C can be 
obtained as A^-step baekward reachable set of such RPI. In this case the MFC horizon N beeomes a free 
design parameter. Sueh a procedure is not fully deseribed here due to the limited spaee. 

Theorem [2] ensures robust feasibility of d3]), robust satisfaetion of (fTbl) . and nominal asymptotie stability, 
in the sense that the closed loop is AS if there exists t G Zo+ sueh that ^k\T = 0, for all r > f, /c G AoM- 
Next, we eombine Theorem [T] and [2l 

V. Indirect- ADAPTIVE MFC: Complete Algorithm 

The last design element in dl]) is the construetion of the parameter prediction vector 

Since in dD is assumed to be eonstant or slowly varying, an obvious ehoiee would be ^k\t = 
for all k G Z[o,Af]> for all t G Zo+. However, this choice violates the assumption of Theorem [T] (and 
implieitly those of Lemmas [H and |3]) that requires = ^k+i\u for all k G t ^ '^o+- Such an 

assumption is required beeause if the entire parameter predietion veetor suddenly ehanges, the value 
function may not be decreasing. This is due to using the pLF only as terminal cost, as opposed to 

enforeing it along the entire horizon [|5l, [|6l, whieh then requires the solution of LMIs in real-time. 

Thus, we introduee a A^-step delay in the parameter predietion, 

^k\t = ^{t — N + k), V/c G Z[o,Ar]. (19) 

Due to (fT9l) . at eaeh time t, the new estimate is added as last element of i.e., = ^{t) and 

^k\t = for all k G Z[o,Ar_i], t G Zo+. We ean now state the eomplete lAMPC strategy and its 

main result. 
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Theorem 3: Consider ([T]), where G S, in elosed loop with the lAMPC controller that at every t G Zo+ 
solves ([3]), where P(^) defined by ® and k{^) defined by ([5]) are from ©, C and are designed 
according to Theorem |2] and G is obtained from (fT9l) . where ^{t) G H for all t G Zo+. If for 

some t G Zo+, x{t) G C, the closed-loop satisfies (fTbl) . and ([3]) is recursively feasible for any t > t. 
Furthermore, the closed loop is ISS in the RPI set C with respect to = ^ — ^o|o i-C-, the A^-steps 
delayed estimation error ,^o|t = ^ — — N). 

Proof: The proof follows by combining Theorem [U with Theorem [2l By Theorem [2l C is RCI, and 
if x{t) G C, ([3]) is feasible for all r > t, for any G that satisfies (fT9l) . since (fT9l) implies that 
■Cfclr = for all k G Z[o,Ar_i]. Thus, by (fT^ enforced in dU), C C A” is a compact RPI for the 

closed-loop system, and hence (fTbl) is satisfied for all t >t. Since is piecewise quadratic for every 
g by taking Xr, = Xl = C, which is RPI for the closed-loop system and compact since CCA, 

the existence of a Lipschitz constant L is guaranteed. Hence, Theorem [T] holds within C, proving ISS with 
respect to ^o|t = ^ — ^o|t = ^ — ^{t — N), i.e., the delayed estimation error. ■ 

Based on Theorem [3l from any initial state x{t) G C, the closed-loop system robustly satisfies the 
constraints for any admissible estimation error, and the expansion term in the ISS Lyapunov function 
is proportional to the norm of the delayed parameter estimation error. Thus, if the parameter estimate 
converges at time t* and such value is maintained for all t > t*, for all t > t* + N, = 0 and hence 
the closed-loop is AS. However, note that ISS holds regardless of such convergence. Finally, note that 
at runtime, the lAMPC solves only a QP as a standard (non-adaptive) linear MPC. Thus, the following 
corollary derives immediately from Theorem [3l 

Corollary 1: The lAMPC designed according to Theorem [3] solves Problem [T] 

The requirement of soling only QP during execution in a significant reduction of computational load and 
code complexity with respect to robust MPC based on LMIs El-llbl. The drawback is on ensuring ISS 
versus the robust stability in ffUl-Q. However, here we still guarantee robust constraint satisfaction. 

A. Comments on parameter estimator design 

The ISS property established in Theorem [3] implies that when the estimator converges to the true 
parameter value the closed-loop becomes AS, but it is more general than that. In fact, ISS ensures 
that, even if the estimate never converges, the expansion term in the Lyapunov function, and hence the 
ultimate bound on the state, is proportional the estimation error. Thus, ISS allows to state properties that ae 
parametric in the estimation error, and hence hold regardless of the convergence of the estimator. Because 
of this and because the lAMPC design does not require a specific choice for the estimator design, we have 
called the lAMPC as independent of the estimator. On the other hand, it is required for the estimator to 
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Fig. 1. lAMPC simulations on the numerical example. Trajectories (black), X'^ (green), C (blue), X (red). 


provide ^{t) G S, for all t G Zo+, as per Assumption [U To enforee Assumption [T| one ean always design 
an estimator that produces the unconstrained estimate q G while the lAMPC uses its projection onto 
S, i.e., ^ = proj=(p). By using the p G in the estimator update equation and providing ^ = proj=(r 7 ) 
to the controller, this amounts to a standard estimator with an output nonlinearity. Thus, the convergence 
conditions will be the same as those for standard estimators, in particular identifiability, and persistent 
excitation. Guaranteeing the persistent excitation in closed-loop systems is currently an active area of 
research also in MPC, see, e.g., [[T3]l - [fT5]l . While it is certainly an interesting future research direction to 
merge the lAMPC developed here with some of the above techniques, it is worth remarking again that 
for the ISS property in Theorem [3] to hold, this is not necessary as convergence is not required. 

As regards to identifiability, a subject that is worth a brief discussion is the case where the true value 
of the parameter ^ is not uniquely define, which may be due to the polytopic representation ([T]) of the 
uncertain system. Given the actual system matrix A the set = {.f G S : Yl\=i[^]iAi = A} may have 
cardinality greater than 1. In this case we can provide a slightly modified ISS Lyapunov function. 

Corollary 2: Let the assumptions of Theorem [T| hold and A) = minfg|(^) 11^ - ^11 . Then for ([B in 
closed loop with the MPC based on ([3]), + 1)) < — Amin(Q)|lx(f)|p + 7iss A), 

i.e., is an ISS Lyapunov function with respect to £:(^, A). 

The proof follows directly by the fact that Theorem [U and all subsequent results only use the difference 
between the predicted and actual system state, which is the same for all ^ G ^(A). Thus (fT^ holds for 
all values ^ G ^(A), which means that it has to hold for the smallest expansion term, which is e(^, A). 
Loosely, this means that while formulated on the convex combination vector for computational purposes, 
the expansion term is a function of the difference between the estimated and actual system matrix. 
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Fig. 2. Simulations with fast (c = 1/2, upper plot) and slow (c = 1/20, upper plot) parameter estimator, [a:]i blue, [x]^ black. 


VI. Numerical Simulations 

First, we show some simulations on a numerieal example. We eonsider ([U), where £ = 5, and Ai = 
[J V], ^2 = 1.1 • Ai, ^3 = 0.6 ■ Ai, ^4 = !]:i] A = [VI i.V]. and B = [-0.035 -0.905]'. While being 

only seeond order system, this example is challenging because some of the dynamics are stable and some 
unstable, and the system matrices are in some cases significantly different. In fact, for a similar system, 
[fT^ showed that without proper cost function adaptation, the closed-loop may not be AS even when the 
perfect model is estimated. The constraints are defined by (fTbl) . where /F = {x G : |[a:]i| <15, i = 
1 , 2 }, W = {m G M : I [m] I < 10 }. We have implemented a simple estimator that computes the least squares 
solution g{t) based on past data window of Nm steps and applies a first order filter on the projection of 
g{t) onto S, i.e., 1) = (1 - <;-)^(/) • proj 2 (^(f)), where G M(o,i), and [^(0)]* = l/£, i G 

Such simple estimator satisfies Assumption [T] because projection, summation and the guarantee that the 
result is a convex combination vector. Also, the least square problem can be regularized by a term based 
on g{t — 1), and the projection can be computed by solving a simple QP. In the simulations we use the 
QP solver in lIlQll . for both projection and MPC control computation. We design the controller according 
to Theorem [2l where C = C°°, and we select Nm = 3 and N = 8, which is the smallest value such that 
5 ' 5 '(n) 3 ^00 ([Yg]) Figure [U shows the simulations where the initial conditions are the vertices of C and 

for each initial condition, 4 different simulations with different (random) values of G H are executed. 
Figure [2l compares the cases where <^ = 1/2 and ? = 1/20, i.e., fast versus slow estimation, thus showing 
the impact of the estimation error on the closed-loop behavior. 
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VII. Conclusions and Future Work 

We have proposed an indireet-adaptive MFC that guarantees robust eonstraint satisfaction, recursive 
feasibility, and ISS with respect to the parameter estimation error, yet has computational requirements 
similar to standard MFC. 

The lAMFC can be easily modified to handle uncertainty also in the input-to-state matrix B, to exploit 
non-maximal yet faster to compute RCI sets, and to account for additive disturbances. Future works will 
detail these, as well considering tracking and designs resulting in a different ISS expansion term providing 
AS even in the presence of a small-but-non-zero error in the parameter estimate. 
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